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(57) Abstract 

A man-machine interface is dis- 
closed which provides force and texture 
information to sensing body parts. The 
interface is comprised of a force actuat- 
ing device (900) that produces a force 
which is transmitted to force applying de- 
vice (902). The force applying device ap- 
plies the generated force to a pressure 
sensing body part A force sensor (909) 
on the force applying device measures 
the actual force applied to the pressure 
sensing body part, while angle sensors 
(91 1) measure the angles of relevant joint 
body parts. A computing device (911) 
uses the joint body part position informa- 
tion to determine a desired force value to 
be applied to pressure sensing body part 
The computing device combines the joint 
body part position information with the 
force sensor information to calculate the 
force command which is sent to the force 

actuating device. In this manner, the computing device may control the actual force applied to a pressure sensing body part to a 
desired force which depends upon the positions of related joint body parts. In addition, the interface is comprised of a displace- 
ment actuating device (901) which produces a displacement which is transmitted to a displacement applying device (902) (e.g., a 
texture simulator). The displacement applying device applies the generated displacement to a pressure sensing body part The for- 
ce applying device and displacement applying device may be combined to simultaneously provide force and displacement infor- 
mation to a pressure sensing body part 
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A FORCE FEEDBACK AND TEXTURE SIMULATING INTERFACE 

DEVICE 

5 TECHNICAL FIELD 

This invention relates to a man-machine interface and in particular to an interface 

that ftv^i oiTM hndy part pnsirinng and pmviffes force and texture feedback to a user. 

10 

BACKGROUND OF THE INVENTION 

A new manner of computer interaction is now in its infancy. The words "virtual 
environment** or "virtual reality** will soon be commonplace. A virtual environment is an 

IS environment where some portion of tbe environment is artificially simulated, most often via 
a computer. A computer may create a graphic simulation of an environment, complete with 
graphic images of chairs, windows, doors, walls, eta, and even images of other people. 
The computer may also simulate environmental sounds. The generated objects may be 
viewed on a common two dimensional display, such as a computer screen, or, by viewing 

20 with special stereoscopic equipment, the objects may be made to appear three dimensional 

The most natural way for an individual to interact in a virtual environment is to 
direcdy control a graphical repr e sen tation of himself. For example, if the individual turns 
his head, the display screen at which he is looking is appropriately updated Also, if the 
25 individual reaches rat and closes his hand, the c ompute r generated image of his hand on 
die screen reaches out and closes. Such virtual environments have been discussed in die 
literature. 

To create the sensation of a virtual reality, die computer should be able to generate 
30 and manipulate graphic images of real or imaginary objects in real time. Although 
generating a graphic representation of an environment may be time consuming and non- 
trivial to implement, much of the theory has been explored and is $,11 understood by those 
skilled in the art of interactive 3-D computer graphics and solid modeling.' The invention 
described here pertains to the important related area in which relatively little research has 
35 been done, Le^ "How may a human user perceive grasping force and texture from his 
computer generated counterpart in the virtual environment?" 

There are many peripheral devices which have been created to allow a user to enter 
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infonnation into the computer. The most notable of these is the standard QWERTY 
keyboard Besides the nnnx^nxx^ 

other devices with their associated permutations. A partial list of such devices includes 
mice, joysticks, trackballs and Computer Aided Design (CAD) tablets. The main drawback 

5 of these computer input devices is that they don't permit human users to enter information 
m a inannerwMc* may be the nwstefi&aemarui natural For example, in a CAD software 
program, the human designer may wish to rotate a 3-D graphic iepieseiitation of a 
a computer screen to view and modify the hidden side. Using currently available input 
devices, the designer must select the axis or a sequence of axes about which the object must 

10 be rotated to acMro the &»rc^ After the desired axis is selected, the 

amount of angular rotation must be determined, usually by the Enear motion of a moose or 
by entering the desired amount of rotation as a decimal quantity via the keyboard. Tins 
whole procedure seems very awkward and iinintuitive when compared to what a person 
would normally do when confronted with a similar task in the "real world," Le^ he would 

15 simply reach out, pick up and rotate the object! Providing feedback for this more natural 
approach to objeo/environment interaction is an object of this invention. 

Instrumented gloves which provide digit position information to the computer have 
been used to manipulate simulated objects in virtual eitvironments. Such gloves have also 
been used in telerobotics to control highly dextrous end effectors to grasp real objects. 
However, lack of force feedback to the glove wearer has reduced the effectiveness of these 
open-loop manipulation approaches. Imagine a 3-D graphic maiel of an egg on a ajinput» 
screen. Suppose you are wearing a glove which maps your digit and hand motions to a 
graphk image of ahand on the same screen as the egg. As you move your hand and digits 
25 me corresponding graphic images of the hand and digits move in a similar manner The 
task is to move your own hand and digits to control the graphic hand on the computer 
screen to pick up the egg. To accomplish this task you must provide enough force to 
reliably grasp and lift the virtual egg, but not so much fern* such that the egg is crushed. 
Without some kind of grasping force and tactile feedback, this task would be extremely 
30 difficult. 1 

Attempts have been made to provide infonnation about simulated contact with 
virtual or telemanipulated objects to senses other than the corresponding tactile senses One 
method of simulated feedback which has been tested uses audible cues. For example the 
35 computer may beep when contact is made. Another simple method is to highlight the object 
once contact is made. Both these methods will require the user to re-learn hand-eye 
cooidinatioa It may be frustrating and time consuimng for me user to learn one of these 
"unnatural" methods of grasping an object, and the sensation of interacting in a virtual 



20 
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environment win be reduced 

SUMMARY OF THE INVENTION 

5 

An object of the invention is a man-machine interface which may be employed in 
interactive computer applications. 

Another object of the invention is a force feedback control system capable of 
10 controlling a set force to a selected part of the body, e.g. f the digit tip. 

Still another object of the invention is a man-machine system capable of simu lati n g 
textures on a selected part of the body, e.g^ the digit tip. 

£5 Yet another object of Ore invention is a man-machine interface comprised of a glove 

capable of sensing digit and hand positions and hand orientation, which may exert, 
measure and dynamically vaiy and control the forces applied to cadi digit, and which may 
vary the tactile array pattern presented to each digit tip. 

20 Another object of the invention is a digitial control system capable of sensing the 

force applied to the digit tip and capable of using fliis signal to aintrol die digit t^foro to a 
desired force set point which may vary as a function of digit position. 

Still another object of die invention is a force and texture feedback system which 
25 may be employed in many different applications, such as virtual environments, 
tdemanipulation and interactive 3-D graphics and Computer Aided Design (CAD). 

A feature of die invention is the use of a flexible housing which maty comprise one 
or more concentric flexible casings which guide a force-transmitting flexible elongated 
30 element such as a flexible, low friction/stiction, low modulus of elasticity thread or a shape 
memory alloy wire which serves as a tendon and is used in tension to apply force to a 
sensing body part or to actuate texture simulating elements. 

Another feature of the invention is the use of a flexible housing which may 
35 comprise one or more concentric inelastic tubes to guide a force transmitting flexible 
elongated element such as pneumatic or hydraulic fluid to a sensing body part to be used by 
a force applicator to apply force to the sensing body part 
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StQl another feature of the invention is the use of "force actuators to generate force 
which is transmitted to the sensing body part via flexible tendon cables, or pneumatic or 
hydraulic tubes, and used by a force applicator to apply force to the sensing body part 

Yet another feature of the invention is the use of force or displacement actuators to 
generate displacement which is transmitted to a sensing body pan via flexible tendon 
cables, or pneumatic or hydraulic tubes, and used by a texture simulator to simulate 
textures on the sensing body part. 

Yet another feature of the invention is die use of a support to which the flexible 
tendon cables or tubes are secured. Ihe support may be a reinforced wrist-strap when the 
sensing body part is part of the hand. 

Another feature of die invention is the use of a pressure, tension and/or force sensor 
to measure die force aplied to die force-sensing body part by the force actuator. 

One embodiment of the invention presents, for the first time, the use of a glove 
incorporating not only sensors which provide analog values representing digit and overall 
hand motion, but also true force feedback to the wearer's digit tips relating the amount of 
force. a corresponding graphic (or actual) device is applying to a given virtual (or 
telemanipulated) object The invention also relates to a means whereby simulated texture 
and edge orientation may be presented to a user. 

The invention, which senses one or more body part positions and provides force 
and texture feedback to one or more body parts, permits a relatively "natural" method of 
computer interaction. The subject device provides in a single unit: (1) controlling body 
part position-sensing means employing a plurality of signal producing means associated 
with individual movable controlling body parts, where the signal is related to controlling 
body part position, with the individual signals analyzed to define a composite signaL The 
signal producing means may be anything which provides body part position and/or 
orientation, including strain gage, electromagnetic, ultrasonic, piezoelectric, hall effect, 
infrared emitter/detector pair, encoder/potentiometer, laser scanning or other optical 
position (and/or orientation) sensors; (2) force-applying means which may be anything 
which provides force information to a sensing body part; and (3) force-sensing means 
which may be anything which provides a force measurement signal; and (4) texture- 
applying means (e.g^ an array of texture elements) which may be anything which provides 
surface pattern (e*g*, texture) information to a sensing body part; and (5) force-generating 
means which may be any actuator which generates a force (or displacement), including 



SUBSTITUTE SHEET 



WO 91/11775 



PCT/US91/00632 



5 



electrical, electromagnetic electromechanical, pneumatic; hydraulic, piezoelectric, shape 
memory alloy (cg^ Nickel/Titanium alloys), vapor pressure actuators; and (6) force- 
transmitting means (eg., a flexible, inelastic tendon guided by a flexible, incompressible 
housing, or an incompressible fluid guided by an inelastic housing) which may be anything 

5 which transmits a force signal from a force-generating means to an applying means (eg., a 
fbice-applying means or a texture-applying means); and (7) signal collection and producing 
means (e.g^ a processor or computer) which may be anything which collects signals (e.g^ 
from the position-sensing and/or force-sensing means) and produces signals (e.g*, for the 
force-applying and/or texture-applying means); and (8) support structure (including clips, 

10 straps, damps, guides, pockets, material, etc.) used to support die body part sensing 
means, the force-applying means, the texture-applying means, the force-generating means, 
the force-transmitting means and die signal collection and producing means, 

TTic signal associated with the controlling bofo part position-sensing means may be 
15 coordinated with die force applied to a sensing body part and also with die texture applied 
to a sensing body part For example, the signal produced by the controlling body part 
position-sensing means may be used by a signal collection and producing means to 
manipulate a nmltiarticnlafed computer generated interactive entity in a virtual environment 
The force-applying means may apply force to a sensing body part in relation to die 
20 interaction between the interactive entity and a component of die virtual environment In 
addition, the texture-applying means may be associated with a surface pattern informative 
signal and apply a texture to a sensing body part to further enhance the sensation of reality 
in relation to the interaction of die entity and a component of the virtual environment 

25 A particular application for die invention is to sense and provide force and texture 

feedback to the hand. A useful embodiment for the invention when used for the hand is a 
"feedback glove." The feedback glove embodiment is comprised of means for measuring 
position and orientation of the hand, means for measuring individual joint angles, means 
for applying force to various parts of the hand, means for sensing the applied force, and 

30 means far applying selected textures to various parts of the hand. Many of the specific 
descriptions of the invention will be centered around the feedback glove, however, the 
sensing and structures described for the glove may be easily translated to other body parts 
(e.g., arms, legs, feet, head, neck, waist, etc.). 

35 In a preferred embodiment of the feedback glove, the means for providing position 

and orientation of the hand is a Polhemus™ electromagnetic position sensor. The 
individual joint angle sensing means is comprised of two long flexible strain gages 
mounted back to back. The strain gage assemblies reside in guiding pockets sewn over 
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20 



25 



30 



35 



gages comprise He two tors ofT^ifT? E^hpairof rwomm 

to be sampled byanaoataHoHHeial com™- iCl • bnd 8 B ™tagesis 

gages are mounted, lie backfae is setearf «, . » «*«* the 

*^u^+JZZ~JZ£ T^T^ ^ witno* 
disclosed in rtv- , 6 ^ incsc joint angle strain gage scnsois are 

The fachdes micn ^ .^T^ ^t^' dP) ' 

-hich do not embody force and texnne feeZT^. £^ ^TT* ^ 
those arising in interactive 3-D ^m. uwanaiaciutates many tasks, such as 

dM-tal-objecB wtaos^bK.c^^pS. V^Dn,,,ra, " 

leased wimappmpr^amimlteirfcoalrolsoft^ , 
provides joint angle sensing and sufficient tactile feedback^T^ feedback glove 

model on a display device. Some vh^ST X J "* ^ 3ppCars 35 a 
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and other features, may be sensed and the virtual objects manipulated using the feedback 
glove. The force feedback incoporated into the glove relays the virtual grasping force 
information to the user, while a texture simulator allows the user to sense orientation and 
motion of edges simply by "touching" virtual objects with his own computer simulated 
5 virtual digits. 

The feedback glove, which provides joint angle sensing and force and texture 
feedback, may also be used for telerobotics. For this application, die feedback glove 
provides joint angle information which is used to control an interactive entity, such as a 
10 robot manipulator , to grasp a distal real object Tie force and texture feedback of die glove 
provide the user with the actual gripping force and the object contours sensed by die 
robot's gripper, so the real object may be reliably grasped and manipulated without 
dropping or crushing. 

IS A glove using farce feedback may also be p rogr amm ed to teach digit dexterity, digit 

timing and even die motions necessary to learn some musical instruments. For example, if 
the user were learning the piano, as digits are flexed, the user would receive digit tip 
pressure form virtual keys signifying to die user that he had pressed the key. Tendons 
similar to those positioned on the dorsal side of the digits to restrict digit flexure may also 

20 be placed on the palm side of the hand. These palm-side tendons may be used to farce the 
digits into the desired flexed positions or to restrict die digits from extending. These 
tendons would be used in the case when the user wanted to be "taught" to play die piano 
and wanted his digits to be properly positioned and flexed far him at die proper times. The 
idea of this example may be extended from a virtnal piano to other virtual ingtrmwnti? *ryr\ 

25 even to other devices such as a virtual typewriter. The feedback glove could be used to 
teach someone to type, and when learned, to allow the user to generate text by "typing in 
the air." 



More specifically, die invention is a man-machine system which, in addition to 
30 measuring actual human joint angles, provides two feedback sensations to the user. The 
first sensation is force. In a pr eferred embodiment, a small device is attached to the digit tip 
of a joint-angle sensing glove and holds a farce-applying platform in juxtaposition to the 
digit tip. The force-applying platform is displaced from the digit tip (by about 4 mm) by a 
retractable means (e.g., a leaf spring) when unactivated, but is capable of quickly 
35 contacting the digit tip and applying a dynamically selectable force when activated. The 
sudden impact of die farce-applying platform provides a sensation similar to that perceived 
when the actual digit tip contacts an object Thereafter, die force-applying platform presses 
against the digit tip with a programmable force which may relate the amount of force that a 
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virtual digit is pressing against a virtual object 

In a prefer red embodiment, die force that is applied by die force-applying platform 
to the digit tip is transmitted from a force generating actuator (a da servo nK)tar)vk a high 

5 tensile strength, flexible tendon enclosed in a flexible, non-compressible tubular casing. 
The function of this assembly is similar to a bicycle brake cable. Other embodiments may 
employ force actuators based on electrical, electromagnetic, electromechanical, pneumatic, 
hydraulic, piezoelectric, shape memory alloy (e.g., Nickel/Titanium alloys), vapor 
pressure, or other suitable technologies. In choosing the appropriate actuator technology, 

10 various factors should be considered, such as speed of response, force output, size, 
weight, cost and power consumption. 

One end of the tendon casing is secured near die force actuator and the other end is 
secured to a wristband near the feedback glove. As a tendon emerges from the end of the 

15 casing secured to the wristband, it is guided by sections of casing affixed to the glove 
Tnatreifll until the tendon reaches its designated final location. Tendons which are to 
provide a force to restrict the wearer from flexing a digit are guided from the wristband 
across the back side of the hand to the final location. A preferred embodiment has these 
tendons passing across die back of each digit and has them mechanically connected to the 

20 forco-applying platform at the digit tip. In addition, a tendon may be terminated at any 
properly reinforced intermediate gjove location. 

As tension is increased, tendons which pass along the back side of a digit press 
against the joints and do not tend to pull die glove material away form the hand or digits. 
25 The tension of die tendon restricts the joints over which the tendon passes from flexing in a 
direction which attempts to extend the tendon further. 

To provide a force to restrict the wearer from extending a digit or to actually drive a 
digit into a flexed position, tendons are guided across the palm side of the glove by sections 

30 of casing. In a preferred embodiment, these tendons arc guided to the digit tip where they 
are ultimately secured to a force-applying platfonn, but they may also terminate at property 
reinforced intermediate positions. Unlike the case where the tendons are guided along the 
back-side of the hand, when the tendons which are guided along the palm-side of the hand 
are in tension, they tend to pull the casing sections (and hence the glove material) away 

35 form the hand. Although not necessary, if it is desired to guide these tendons along the 
surface of the palm and digits as they pass from where the casings are secured to the 
wristband to their final designated locations, the glove must be appropriately reinforced 
between each joint 
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Where the tendons aie rooted and whoe they axe ultimately seemed to the glove 
will determine the forces applied to the hand by the tendon. Forces and torques applied to 
parts of the hand by a single tendon may not be controlled independently. Only the force 

5 applied to one part of the hand or the torque applied by the tendon to an individual joint 
may be controlled. In a preferred embodiment, the tendons are fastened to the force- 
applying platfoims at the digit tips, and the forces at the digit tips are measured and 
controlled, not the torques applied to the joints. To isolate the force and independently 
restrict motion of a single intermediate joint, a separate tendon is used Its casing is 

10 secured just prior to the joint, and die tendon is fi^tened to a force-applying platfonn^ 
beyond the joint As previously mentioned, the glove is properly reinforced near the joint 
SO thr glov^ material rinftgn't nnrinly stretch imder the force of the tenrinn. 

When force is initially applied by a force actuator, the farce will appear between the 
IS wristband and the intended digit Therefore, the wristband will tend to move towards the 
digit as the "slack" in the skin on die wrist is taken up. The tendency for this relative 
motion can be reduced by incorpor at ing a means which initially takes up the slack in this 
skin. Once this slack is taken up, die wristband will stop moving, and the digit will 
experience the foil tendon force (except for frictional losses). If the slack in the wrist skin 
20 is not irritiaHy taken up, to jrovide a realistic 

sufficiently high bandwidth such that this slack take-up time is insignificant when 
compared to the bandwidth of digit motion. 

Tn fl pr r ** * 1 "?** wn^tmwif ftif. nrfnal fntw gf thi» Higit rip is tfJiwi and feH hflrfr fn 

25 a servo control system. The centred system controls die output of the force actuator such 
that the force applied to the digit tip follows a desired force profile regardless of the 
undesireable compliance of the skin on the wrist The force profile for any digit is a 
function which produces a desired force set point for any given digit and hand position. 
That is. as either the digit or hand changes position, the force applied to the digits varies 

30 accordingly. For example, a force profile may be generated which simulates the force 
sensation of a push button switch that gradually increases its opposing force as the button 
is depressed until it reaches its toggle point, clicks, and releases most of its resistive force. 

In addition to providing object contact and force information, the invention 
35 describes a means whereby object textures and edge orientations may be perceived. For 
one embodiment, the previously described digit tip force applicator may be modified to 
include an array of small stimulators, called texture elements. These elements produce a 
surface pattern (e.g^ a simulated texture) in addition to providing force feedback. Each 
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texture element may be individually selected The texureeleziKntm^r be a small pin which 
extends when selected and the amount of its extension may be programmed. The texture 
element may also be a pair of electrodes, and tactile sensation produced via 
electrocutanemis s tiwn ilarion. 

5 

In a preferred embodiment, the texture elements are driven by a texture 
displacement actuator. A flexible bundle of force feedback and texture simulating tendons 
connect die glove to both die farce and texture actuators. The type of displacement actuator 
for a texture element may vary. A particular embodiment may employ binary or linear 

10 displacement actuators and the actuators may be based on electrical, electromagnetic, 
electromechanical, pneumatic, hydraulic, piezoelectric, shape memory alloy, vapor 
pressure and other suitable technologies. In choosing the appropriate actuator technology, 
various factors should be considered, such as speed of response, force output, size, 
weight, cost and power consumption. If pnramarin or hydranrics is nsed, * h < »mv.tTr fl ny 

15 sealed flexible tubing assembly is used to connect the texture actuator to the texture 
element Otherwise, the connection may employ a cabling means comprised of a tendon 
inside a casmg.smrto to that used to tra^ 
applicator. 

20 If a binary actuator (e.g^ a two-state solenoid) is used, then the texture element win 

either be fully extended or fully retracted. If a linear actuator is chosen (e.g., ad.c servo 
motor) then the extension of the texture element may be continuously varied. The force 
with which the texture is presented to the digit tip is determined by the force actuator. The 
pattern of the texture array may be varied with time and reflect changes in the position of 

25 the joints or hand. For example, by dynamically varying the texture array, a user may 
perceive his virtual digit moving over various (e.&, smooth/tough) virtual surfaces. Using 
die time varying texture array, a user mayalso determine the edge orientation of a virtual or 
telemanipulared object 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. la is a perspective view of a tendon/casing assembly. 

35 FIG. lb is a cross-section for the perspective view of FIG. la. 

FIG. 2a is the side view of an embodiment of the invention showing the force- 
transmitting tendon assembly affixed to a glove. 
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FIG. 2b is a cross-section view of an embodiment of the invention which shows 
tendons affixed, via tendon guides, to material covering a digit: one tendon to the back side 
and one tendon to the palm side of the digit 

5 

FIG. 2c is an embodiment of die invention which shows tendons affixed to provide 
farce feedback to other body parts (eg., the arm). 

FIG. 3 is the side view of an embodiment of the invention showing the texture 
JO simulating tendon assembly affixed to a glove, 

FIGS. 4a and 4b show an embodiment of the invention where force tendons are 
affixed, via tendon casings, to both die palm and back side of the digit tip of a glove. One 
end of the tendon casing is seemed to a wrist portion of the glove, and the other end is 
15 fastened to the force applicator assembly on the digit tip. 

HGs. 5a - 5h, and FIGS . 6a -6c show various force applicator embodiments. 

HGs. 7a and 7b show the force applicator modified to simulate, in addition, texture 
20 information. 

FIGs. 8a- 8m show various texture simulator embodiments. 

FIG. 9 is a schematic electrical/mechanical signal propogation diagram. 

25 

FIG. 10 is a control system block diagram for control of die digit tip force. 

HGs. 11a - lid show a force applicator embodiment which employs a load cell to 
sense force applied to the digit tip. 

30 

HGs. 12a and 12b show a force platform capable of pivoting to make the contact 
pressure between the platform and the digit dp uniform. 

HG. 13 is a side view of a force applying platform where the pressure distribution 
35 may be modified by adjusting tendon tensions differentially. 

HGs. 14a and 14b show the side and plan views of an embodiment where the force 
applying platform is capable of pivoting in any direction and thus can move the location of 
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the centroid of pressure. 

FIG. IS is a side view of an embodiment showing how the tension in the tendon 
may be measured prior to the platform contacting die digit tip. 

5 

FIGs. 16a and 16b are side views of two more methods to measure tendon tension. 

FIGs. 17a and 17b are side views of two embodiments of a structure which 
supports both a bend sensor and a fbrce-traristnitting tendon. 

10 

FIGs. 18a and 18b are a perspective and plan view of an embodiment which 
provides a pre-tension between a force f(»dback glove and the casing sup^ wristband 

FIG. 19 is the block diagram of a three-loop force control system. 

15 

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 

FIGS, la and lb show how the force generated by a fbnx actuator may be transnntte^ 
20 chosen location. More specifically, Ha la shows a perspective view of a tendon 
assembly, and FIG. lb shows a cross-section view. The tendon assembly is comprised of 
a low friction, high modulus of elasticity and high tensile strength, flexible tendon cable 
100 (e.g., Dacron™ 20 lb. test fishing line or Kevlar™ thread) inside an assembly 
employing one or more concentric flexible, low-compressibility tubular casings 101 (e.g, 
25 Teflon™ tnbing). One end 102 of the casing assembly is secured near the force actuator 
and the other end 103 of the casing is secured near the location where the force is to be 
applied (e.g., for a feedack glove, the casing may be secured to the wristband, and the 
force applied to die digit tip). By using a plurality of concentric casings (eg., a #20 Teflon 
tube inside a #14 tube) rather man simply increasing the thickness of the wall of a single 
30 casing, the resulting tendon casing is more flexible (since the casings may slide relative to 
each other) and still produces an overall compressive strength nearly equal to that of a 
single casing of equivalent wall thickness. 

FIG. 2a is a side view of a force feedback tendon assembly affixed to a glove 200. 
35 In this embodiment, each tendon force is generated by a d.a servo motor 201. The motor 
is driven by a current amplifier so mat a motor torque is produced which is proportional to 
the amplifier current This torque is converted to a tendon force by die tendon pulley 202 
on which the tendon cable 203 is wound. By securing one end 204 of the tendon casing 
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near the motor and tbe other end 205 to the glove's reinforced wristband 206, the tendon 
force produced by the motor may be transmitted to the glove. In a preferred embodiment of 
die invention, the wristband is comprised of a sturdy, reinforced strap with VelcnP 1 
backing wrapped around a thin, rubber (cg^ polyurcthane) intermediate layer. The rubber 

5 layer provides a comfortable interface between die reinforcing strap and the user's wrist 
The strap is made fiom a heavy-duty thiead (e.g^ canvas) which is woven to allow it to be 
flexed around a wrist, but to otherwise provide a sturdy support En general, the wristband 
may be manufactured from a variety of materials such as foam padded injection molded 
plastic The wristband may be manufactured as part of the glove or made as a separate 

10 unit 

The tendon cable passes through a series of tendon guides 207 as it extends 
beyond the point where the casing is secured to die wristband on its way to die digit tip 
force applicator. In one embodiment the tendon guides for the back side of the hand are 

15 made fiom flexible, but incompressible casing (eg* Teflon tubing) and fastened ova* the 
metacarpophalangeal (MP) 208 and proximal intexphalangeal (PIP) 209 joints. These 
guides prevent die tendons from moving laterally and slipping off the sides of the joints as 
the knuckles protrude during flexure In the embodiment where the glove has tendons 210 
on the palm side of the hand, and it is desired to have the tendons remain close to the hand 

20 when they are in tension, tendon guides 211 are located between the MP and PIP joints 
and also across the palm to keep the tendon from pulling away fiom the glove. The glove 
is also reinforced in a variety of places to prevent die glove fiom being pulled away from 
the hand by the tendon guides. Tendon guides may be affixed to the glove by such means 
as sewing or gluing, or die casings may be molded directly onto/into the glove. 

25 

Tbe digit tip force applicator 212 (shown generically by the cross-hatched portion 
of the digit tip) applies both back-side and palm-side tendon forces direcdy to the digit tip. 
Also on the digit tip force applicator assembly is a force transducer for each tendon which 
senses the actual force applied to the digit tip. These force signals arc fed back to the motor 
30 force control system which makes appropriate adjustments such that the desired force 
profile is perceived by the user. 

FIG. 2b is a cross-section view of an embodiment of the invention showing force 
feedback tendons 216 passing through guides on both the back 213 and palm 214 sides 
35 of a glove digit Both tendons are attached to die force applicator at die digit tip. In a 
preferred embodiment, when the tendon guides are affixed to an elastic glove, only the 
palm-side tendon guides need reinforcement to ensure that they remain against die digit 
when the tendon is in tension. One way to accomplish die reinforcement is to fasten 
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additional material 215 of low elasticity (eg. nylon, plastic, or metal) aitmnd the digh at 
me base oftbe tendon guide. 

HG. 2c shows a force feedback tendon/casing assembly applied to the arm. 
Casfags217nayl*seciir<ritoaiei^ Thestrap 
is similar in construction to the wristband previously described and also employed here. 
Both the tendons shown exit the casings on tnebkxp and are atlaed to the wrists 
Onetaidon220provia«afoicewfa^ 

tendon221 provides a mice whicA restricts^ Assemblies similar 

tome«iesshownmHG.2a-2cii»ybeiiic^^ 

ant which covers all, or portions of the body, and which can apply force and textnre 
information to various parts of die body. 

FIG. 3 is a side view of a textnre simulating tendon assembly affixed to a glove. 
15 The tendon displacement in this emboourieiit is gei^rated by a two-state 

soleiK)id300aiKlisttaiismiaedtDthedigk ^ 
tendon assembly shown here is sinuTarmfunctiMtotte 

far FIGS, la and lb, however, the diameter of both the tendon and casing may be smaller 
smce the forces these texture tendons need to exm ate less than the f^ 
20 force feedback tendons. 

One end 302 of the tendon casing for the texture simulator is secured near the 
displacement actuate, and a pcri^^ 

glove's reinforced wristband. After the casing is affixed to the wristband, it continues on 
25 and is fastened to the glove at various locations 304 between the joints on its way to its 
designated final location, which in this embodiment is the digit tip texture simulator 3 0 5 
Casings may be affixed to the glove by such means as sewing or gluing, or the casings 
may be molded directly onto/into the glove. In the embodiment shown, there is slack 306 
in the casing between points where it is affixed to the glove to aflow for the tightening of 
30 the casing when the digits are bent Hie casings may also be guided along the sides of the 
digits without allowing for slack since they won't be stressed when the digits are bent 

HG. 4a shows a plurality of force feedback tendons 400 and their guides 401 
Although the texture feedback discussed in HG 3 may be used simultaneously with force 
35 feedback, the texture producing tendons have been omitted from this drawing for clarity. 
The tendon casings 402 are shown secured to the reinforced wristband 403. In this 
embodiment, there is one tendon on the back ofeacAdigk to ctmtrol the force appKed to the 
digit tip. In addition, the figure provides an example of an abduction force feedback tendon 
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404 on the thumb side of the index digit 

Force is imparted to each tendon from a fbice actuator. In the embodiment shown, 
ibices axe transmitted to the glove via a tendon assembly similar to FIGS, la and lb. One 

5 end of the tendon casings is secured near the force actuator, and at the other end is fastened 
to die glove's reinforced wristband. Tendons 40S intended for the palm side of the glove 
extend around die wristband as shown. These tendons 400 intended for the back side of 
the hand emerge from die casing on die wristband and are guided along the back surface of 
the glove by sections of casing 401 until they reach die desired final location. In the 

10 embodiment shown the final tendon location is the digh tip fonxsapplkatcr 406. 

FIG. 4b shows a force feedback tendons 405 guided around the wristband to the 
palm side of a glove. The palm-side tendons then emerge from their casings on the 
wristband and are guided through sections of casing 407 on their way to the digit tip force 
15 applicator. 

One useful yet uncumbersome and inexpensive embodiment of the invention 
employs force feedback tendons only along the back of the hand to the tips of die thumb 
and index digits, and employs texture elements only on the index digit tip. This "reduced" 

20 embodiment is in contrast to employing both force feedback and texture simulation to each 
joint of all five digits. The reduced embodiment provides the wearer with sufficient force 
feedback information to grasp most virtual objects and also allows the wearer to sense 
virtual textures with die index finger. Although, employing force feedback to all joints on 
all digits and texture simulation to all digits t^s will provide the wearer with a more realistic 

25 simulation of his virtual environment, the increase in realism may not outweigh the added 
cost and complexity of the system. 

FIGS. Sa-Se shows a digit tip force feedback applicator which is comprised of a 
force-applying platform and a force-sensing platform. FIG. 5a is a perspective view, FIG. 

30 5b is a front view, HG. 5c is a bottom view, and FIGS, 5d and 5e are side views. 
Modifications may be made to this functional design without departing from the scope of 
the invention. The force feedback applicator may be manufactured directly into the glove 
material (as might be done if the glove were molded from a type of plastic). The applicator 
may also be affixed to the glove externally after both the applicator and glove are 

35 manufactured separately. The force applicator may also be a device which is simply 
clipped to the digit tip after the glove is put on. 

In a preferred embodiment, a force tendon 500 is guided from the force actuator to 
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the force feedback applicator, splits into two tendons, each tendon passing by the force- 
applying platform 501 though holes), and mechanically connected to the ends of the 
force-sensing means, which is a force-sensing platform 502. The force feedback 
applicator structure 519 provides support for holding the force-sensing and force-applying 
platforms in juxtapositon to the digit tip. The force-sensing platform is forced via the force 
of the tendon towards the digit tip. The force-sensing platform presses against the force- 
applying platform which then contacts and applies force to the digit tip (FKL5e). When 
there is little or no force in the tendon, the W-applykg platform is displaced to ^ 
digit tip by about 4 mm and is held away by a retractable means such as small springs 
(FIG.5d). Leaf springs 503 are employed in the embafrnent shown. By keeping the 
fcrce-applymgplatfam displaced 

applied, bandwidmieqoirenients of tte R» example, when me 

invention is used to provide feedback from a virtual environment and a virtual object is 
grasped, the force-applying platform assumes an activated position and contacts the digit tip 
wimarioiH2erorelatryevelc<aty,as fflhe 
face-applying platform were always in contact with the digit tip, very large tendon 
velocities and accelerations would have to be generated to provide the same contact 
sensation to the user. 

The ffflce-sensing platform may be simply a strain gage beam which bends across a 
fulcrum 504 as tendon force is applied. The fulcrum shown in FIGS. 5a - 5f is thin and 
concentrates the applied force over a small area such that the induced strain is easily 
measured by the two strain gages 505, 506 mounted (iifferentially to either side of this 
force-sensing platform. 



Alternative fulcrum designs arc possible such as shown in FIG. 5g. By modifying 
the fulcrum shape and contour, various stress vs. tendon force profiles may be obtained 
For example, the fulcrum design of FIG. 5g will provide a higher strain "gain" for low 
strains than the fulcrum of FIG. St, Le., the detected strain will be large for small forces, 
but the stram gain will decrease as the force-sensing platform bends around the fulcrum. 
As the force-sensing platform bends around the fulcrum, the measured strain includes not 
only a component from bending but also includes a component from tension in the 
platform. By varying the contour, and thus the strain sensitivity of the force-sensing 
platform, small forces are detected with fine resolution, but the sensor will not saturate as 
35 qmcMy for higher strains. Further mxiifications of the fulcrum and platform geometries 
produce additional strain vs. force profiles. 

As shown in FIGS. 5a - 5g, when tension is applied to the tendon, strain gage 505 
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is in tension and strain gage 506 is in compression. Both strain gages are active and cover 
the axea of die platform experiencing strain. Together, die two strain gages form a half 
bridge for a common Wheatstone bridge circuit which provides temperature compensation. 
The fulcrum and all other parts of the force applying platform that touch the force sensing 
5 platform are made from a thermally insulating material to insulate die strain gages on die 
force-sensing platform from die temperature fluctuations of the digit 

FIG. Sh shows a force-sensing means, comprised of two strain gages 507, 508, 
mounted to opposite sides of a flexible stress-sensing element 509 which is placed in 

10 series with the tendon and experiences a tensile force related to the tendon force. The 
stress-sensing dement may be a flattened portion of the tendon itself. This stress-sensing 
element may be used to measure die tendon tension and/or the joint angles. One strain gage 
507 is mounted to die top side of the element, while the second strain gage 508 is 
mounted to the bottom side. In the embodiment shown, die stress-sensing element is used 

IS to measure both tendon tension and joint flexure. Therefore, the entire gage-element-gage 
"sandwich" is positioned in, and slides freely through, the casing guide 510, which has a 
rectangular cross-section in tins region. Both gages are covered with a smooth, flexible 
encapsulation 511 (cg^ a type of plastic) which provides die surface that slides against die 
casing. The differential signal from die two gages is used to determine die joint angle, 

20 while the common mode signal fnra the same two gages provides a measure 

tension. The stress-sensing element may be made from a non-flexible material and located 
between joints when only a measure of tendon tension is desired. The force in the tendon 
near the digit tip closely approximates the force applied by the force-applying platform to 
the digit tip. If the tendon tension is found using the stress-sensing element described here, 

25 the force-sensing platform previously described may be removed from die digit tip force 
applicator, and the mechanical design may be simplified to a single platform512. 

FIG. 5i shows how a force may be focused to restrict flexure of a single joint (e.g^ 
the PIP joint as shown in this figure). The tendon casing 513 is secured to a first 

30 reinforced section 514 of the glove just prior to the selected joint The tendon 515 exits 
the main casing and is guided ova: die joint by a section of casing 516, which is fastened 
to a second reinforced section 5 17 of the glove. The tendon exits the casing and forks into 
two tendon parts (as is shown 520 for the digit tip force-applying platform of FIG. 5a). 
The two tendon parts pass around opposite sides of the digit and are affixed to opposite 

35 ends of the force-applying platform 5 18 , which is secured to the second reinforced section 
of the glove. The platform assembly contacts and presses against the digit when the tendon 
515 is in tension. 
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The same method of operation can be spplkd to restrict the joint from cxtendin g as 
was described above to restrict the joint from flexing. A second tendon casing 521 is 
affixed to die first reinforced section of the gtove. A second tendon 522 emerges from the 
casing and forks into two tendon parts. The two tendon parts pass around opposite sides 
5 of the digit and are affixed to opposite ends of the force-applying platform 523. The 
platform assembly contac ts and presses against the digit when the tendon 5 2 2 is in tension. 

In die case where it is undesireable to reinforce the glove to support sections such 
as 514 and517 t FIG.5j shows away to provide force feedback to 

10 an nnreinforced glove. If the glove of FIG. 5h were not reinforced near sections 514 and 
517, then when tendon 515 was in tension, the two sections would be drawn towards 
each other. A possible solution would be to place a hinge between the sections to prevent 
than from simply sliding together. However, since the bend axis of a digit may translate 
and change orientation with bend angle, a single hinge would be uncomfortable for a glove 

15 wearer. 

A preferred alternative to the "fixed hinge" solution is shown in FIG. 5j, where 
sections 524 and 525 are in contact with each other and produce a pivot surface 527 
when tendon 526 (emerging from casing 530) is in tension. The pivot surface is created 

20 by the two mating flaps 528 and 529, which each have a characteristic surface contour 
designed to follow the average knuckle axis during flexure. As the tendon tension 
increases, the two sections press against each other and section 525 is forced to rotate 
clockwise, while section 524 rotates counter clockwise, each section rotating about the 
"moving" contact pivot point The two sections are able to slide axially relative to the digit 

25 so they may contact each other when tendon tension is applied, and also so the same 
surface contours for the two sections will accomodate a variety of different knuckles- The 
two flaps, in addition to possessing a contour, may also have mating surfaces, such as 
mating groves, to prevent one surface from sliding off the other surface. 

30 To keep the sections secured to the digits, the sections may be made from a solid, 

but elastic material (such as a plastic or spring metal), which is pre-fonned to clip around 
the digit, as shown in FIG. 5j. The firm elastic strap 530 helps hold the two ends 531 of 
the clip together. One end of the elastic strap is permanendy secured to one side of the clip, 
while the other end 532 of the strap is secured to die other side of the clip by Velcro" 4 

35 533. The elasticity of the clip, together with the elastic strap, hold the section firmly to the 
digit, but, since the clip and strap are elastic, they allow the digit diameter to expand when 
the digit is flexed. 
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la some instances, it may be preferred to have a linkage attached to the sections, 
such as is shown in FIG. SL For example, if a rotaiy goniometer (eg., a potentiometer, 
an optical encoder, or a rotaiy Hall effect sensor) were attached to the linkage at the joint 
534 between die two links 535 and 53 6 , the value of the goniometer may be related to the 

5 joint angle of the knuckle. When die linkage is employed, the force feedback assembly of 
FIG. 5j may still be used, however, as shown in FIG. 51, the tendons may also be affixed 
directly to the linkage. A first casing 537 is affixed to Knk 535 and tendon 538 is affixed 
to link 536. Similarly, a second casing 539 is affixed to link 535 and tendon 540 is 
affixed to link 536. When tendon 538 is in tension, link 536 is pulled to rotate 

10 clockwise, forcing the digit to extend. When tendon 540 is in tension, link 536 is pulled 
to rotate counterclockwise, forcing the digit to flex. 

Note that in FIG. 51, supporting sections similar to those used in FIG. 5j are 
shown. If the glove is appropriately reinforced, other support sections, such as shown in 
15 FIG. 5i» may be used. Also note that in FIGS. 5j-51, farce-applying platforms may be 
employed to focus the applied force to a particular region of die digit In addition, for 
clarity, force feedback tendons for die palm-side of die hand are not shown in FIGS. 5j-51, 
however, they may be employed in an obvious manner. 

20 FIGS. 6a - 6c show an embodiment of the force feedback applicator which 

produces force feedback from a tendon affixed to the palm side of the glove. This 
configuration provides a force which restricts the digit joints from extending and may also 
force them to flex. FIGS. 6a and 6b show side views, while FIG. 6c shows a top view. 
For clarity, only the apparatus specifically required for palm-side tendons is shown, but the 

25 force applicator may additionally include the apparatus shown in FIGS. 5a - 5e. Tendon 
force is generated by an actuator and transmitted, as shown in FIGS. 1 and 2, to the force 
feedback applicator. As shown in FIG. 5a, the tendon 600 is guided past the force 
applying platform 601 (e.g., through holes), and is affixed to the force-sensing platform 
602. The force-sensing platform again has two strain gages connected differentially in a 

30 half bridge configuration. The force-applying platform is also as before and has a stress 
concentrating, thermally insulating fulcrum on die side opposite to the digit The insulating 
fulcrum prevents heat conduction from the digit to the gages on the force-sensing platform. 
The force-applying platform is displaced above the digit nail by springs (FIG. 6a) and 
contacts the digit nail only when a force is applied to the tendon (FIG. 6b). In the 

35 embodiment shown the springs are leaf springs 603. The applied tendon force presses the 
force-sensing platform into the force-applying platform which then presses against the digit 
naiL As the force-sensing platform presses against die force-applying platform, the 
platform is bent around the fulcrum and produces a strain in the gages indicative of the 
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farce applied to the digit nail. 

FIGS. 7a and 7b show an embodiment of a digit tip texture simulator. FIG. 7a 
shows the top view, while FIG. 7b shows a view looking at die the texture simulator from 

5 the digit tip. The particular embodiment shows a 3x3 texture array 700, where the texture 
elements are spaced on 3 mm centers and extend 1 mm when activated. Texture arrays 
employing various numbers of texture elements may be constructed. The texture array is 
contained within a modified force-applying platform 701 and held in juxtaposition to the 
digit tip by the supporting structure 519. As shown, this texture simulator assembly may 

10 also provide force feedback by including die same force-sensing platform 702, fulcrum 
703, and strain gages 704 as described in FIGS. 5 and 6. In FIGS. 7a and 7b, the 
actuating mechani sm for the texture dements is not shown. 

Displacement may be delivered to the digit tip texture simulator from the 
15 corresponding actuator as previously described in FIG. 3 via a tendon cable/casing or 
tubing assembly, by electiical wires, or by pneumatic or hydraulic means. FIG. 8a is a 
cross-section view where a tendon 800 oxters the digit tip texture srmniator 801, and 
when actuated, pulls on the base of a corresponding spring-loaded texture element 802 to 
raise it When raised, die texture element extends from within its enclosure and presses 
20 against die digit tip. When the tendon force is reduced, the spring 803 causes the element 
to retract back into the digit tip texture simulating enclosure. In all of FIGS. 8a -8m, the 
diagram on the left shows the unactivated state and the diagram on the right shows the 
activated state. 

25 FIG 8b is a cross-section view of a digit tip texture simulator where a tendon pulls 

on the L-shaped bracket 804, rotating it counter clockwise. As it rotates, the bracket 
pushes on the texture clement which then extends from the digit tip texture simulator 
enclosure and presses against the digit tip. When tendon tension is removed, the spring 
805 returns the texture element to its original, unextended position. 

30 

FIG. 8c is a cross-section view of a digit tip texture simulator when either 
pneumatics or hydraulics are employed. A positive pneumatic or hydraulic pressure 
extends the texture element and a negative pressure retracts it. 

35 FIG. 8d is a cross-section view of a digit tip texture simulator where another type 

of pneumatic actuator is used. When actuated, air enters the device and exits through the 
nozzle 806. This focused air stream creates a tactile sensation on die digit tip. 
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HO. 8c is a cross-section view of a digit tip texture sinnilaior where a tendon 807 
pulls on tbe bar 808 causing it to pivot The pivot may either be a hinge with a return 
spring or a living hinge 809 (as shown). A texture element 810 is attached to the bar 
which protrudes from the enclosure and presses against the digit tip when the bar pivots. 

FIG. 8f is a cross-section view of a digit tip texture simulator where a tendon 811 
pulls on a wedge 812 causing it to slide imderneath and raise the texture element 813. 
When tendon force is released, the spri^ 814 returns the wed^ to to 

Ha 8g is a ooss-sectkin view of a digit tip tex^ 
piilkrathenrildkhingeS^ 

818. When tendon force is released, the spring 819 returns the hinge to its initial 
position. 

15 HG.8hfuiictioiissinrilariytoHG.8g,bmmeh^ 

flexible beam 820. The beam is initially curved, as shown. When a tendon force is 
applied, the beam straightens, forcing the texture element up. 

FIG. 8i is a cross-section view of a digit tip texture simulator where the texture 
20 e^tisraisedbygcKratmgapressuiebyhe^ 

of the two 821. Current is passed through the resistive heating coil 822, causing the 
varxjr(OTliqjud) to heat up and«cpand and raise tte 

HG. 8j is a cross-section view of a digit tip texture simulator where the texture 
25 element is raised by piezoelectric elements. A voltage applied to a piezoelectric element 
causes it to either expand or contract depending on the voltage polarity. In the figure, there 
are two separate pieces of piezoelectric material connected to form a "Dimorph". The two 
element arc wired with opposite polarities such that when a single voltage is applied, one 
piezoelectric element 823 expands white the other element 824 contracts. When one 
expands and the other contracts, the bimorph bends towards the direction of the element 
which contracts. A texture element 825 is attached to the free end of the bimorph and 
protrudes from die enclosure when the bimorph bends. 



30 



HG. 8k is a cross-section view of a digit tip texture simulator where a texture 
35 dement 826 acts as the plunger of a electromechanical solenoid. As current is applied to 
the coil 827, the texture element is raised. A spring 828 returns the texture element to its 
initial position when the current is removed. 
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FIG. 81 is a cross-section view of a digit tip texture simulator wbcrc a flexible, 
relatively incompressible fiber 829 (similar to a fiber optic wire) is vised. The fiber resides 
in a flexible, but incompressible outer casing 830 (similar to the tendon/casing assembly). 
The fiber transfers displacement generated at one location (possibly by a bulky or heavy 
5 displacement actuator) to a second location (eg., the digit tip) by sliding relative to the 
outer casing. The principle of operation is similar to a catheter tube. The end of the fiber is 
die actual texture element wiiidi protrudes aiui presses against tte The difference 

between this "fiber" method and the tendon method is that die tendon is "active" in tension 
while the fiber is "active" in compression. 

10 

FIG. 8m is a cross-section view of a digit tip texture simulator where a magnetic 
attraction, in this mHnrimy mf gmT^t**! Ky rf<>rftrmriflgfiftr 834, pulls on the metal bar 832 
causing it to pivot The pivot may either be a hinge with a return spring or a living hinge 
831 (as shown). A texture dement 833 is attached to the bar which protrudes from the 
15 enclosure and presses against the digit tip when the bar pivots. This texture simulator 
embodiment can be realized with micxonxnoifrttcroactuator technology. 

In the embodiments shown in FIGS. 8i, j,kandm, the actuation displacement for 
the texture simulator is generated in the digit tip force applicator enclosure itself! Any of . 
20 these same actuator technologies may be employed, but positioned at an alternate location 
(cg^ on the wristband or at die same place as the force actuator). The displacement may 
then be tran sfer red to die digit tip by a tendon or pneumatic/hydraulic tube and used by any 
appiry p^i flt^ texture ytwwifatf^ r. 

25 In addition to the actuator technologies shown in FIGS. 8i, j, k and m, other, more 

standard force and displacement actuators such as electromechanical motors and pneumatic 
(hydraulic) compressors (pumps) may be used. Shape memory alloys (SMA, e.g., 
Nickeyiitanium alloys) may also be used to generate the tensile force or displacement of a 
tendon. SMA wire has the property that it contracts when heated. The wire may be heated 

30 simply by passing an electrical current through it. 

FIG. 9 shows how the electrical and mechanical signals propogate through the 
force/texture feedback control system. FIG. 10 is a diagram of the force and texture 
feedback control system in standard control theory block diagram form. The embodiment 
35 shown employs a <Lc. servo motor 900 for force actuation and an electromechanical 
solenoid 901 to produce the displacement for a texture simulating element 902. A 
computer sends a digital value representing the desired force to a <Lc servomotor control 
circuit In the embodiment shown in FIG. 9, the desired force is presented to the digital-to- 
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analog converter (DAQ 903. The analog output of (be DAC is then amplified by a 
variable gain amplifier 904. This amplified force set point voltage is then converted into a 
anient by a common voltage-to-cunent configuration of a power operational amplifier 
905. Hns current drives the servo motor at a desired torque. Velocity damping of die 
5 servo control loop is performed by tachometer fecdback906. 

Torque generated by the motor is converted into a tensile force by a pulley 907 on 
the motor shaft The of this pulley is selected to achieve the desired force and 

speed of response for a given motor. In a preferred embodiment, a pulley diameter of 1/4 

10 inch was used. Hie generated tensile force is transmitted to the digit tip force applicator 
from the force actuator via a tendon cable/casing assembly 908. The force applied to the 
digit tip is sensed by the two strain gages 909 mounted differentially to the strain sensing 
platform and wired into a half-bridge configuration. A full Wheatstone bridge is used to 
amplify the detected force. This amplified signal is digitized by an analog-to-digital 

15 converter910 and read into the computer 911. 

The computer implements a force control law 912 (e.g^ Proportional-Integral- 
Derivative or state feedback) using well understood techniques from the field of digital 
control. The control law incorporates die feedback force information 913, and servos the 

20 motor to produce a desired force at the digit tip. Digitized values 914 from analog joint 
angle sensors provide the information die computer needs to determine the force set point 
915. In a preferred embodiment, the computer converts digit joint angles into actual digit 
positions. If one of the digits is found to be intersecting a virtual object, the computer 
calculates the force to be applied to that digit using knowledge of the virtual object's shape 

25 and compliance 916. In a prefe rred embodiment, differential strain gage angle sensors 
917, as disclosed in the Kramer et aL patent application, are used to determine joint angles. 

As shown in FIG. 9, the computer also outputs commands to the displacement 
actuator of the texture simulating array. In the embodiment shown, the computer outputs 

30 digital values which control solenoid drive transistors 918. For example, a logical value of 
**1" turns the transistor "on," and a logical "(T turns the transistor "off." When the 
transistor is on, the solenoid coil is energized, and the plunger 919 is retracted. The 
retraction generates a displacement which is transmitted to the texture simulator 902 via a 
tendon cable/casing assembly 920. The texture simulator uses die displacement to extend 

35 the texture elements beyond the surface of the digit tip force-applicator platform against die 
digit tip. When the transistor is turned off, die solenoid plunger is extended by the return 
spring and cable tension is released. When the tension is released, die texture element is 
retracted back into the texture array platform housing by its own return mechanism. 
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FIGs. 1 1 a- 1 Id arc fimctionally similar to FIGs. 5a-5e in that they all poses a force- 
applying means and a force-sensing means. The difference is in the force-sensing means. 
In FIGs* 5, the force-sensing means is shown as a force-sensing platform. In FIGs. 11 
5 the force-sensing means is shown to include a load celL The load cell 1100 may employ 
any of a wide variety of technologies, such as strain gage, capacitive or resistive sensing 
technologies, and the like. Besides the more common strain gage load cells, force sensor 
pads which use capacitive sensing technoto^ 

resistive force sensing pads are available commercially by IntgHinlr andTekScan. In FIGs. 

10 11, the force-sensing means comprises part of the force-applying means. Hie force- 
sensing/flying structure conqnises a platform 1101 which is affixed to support 1102. 
Support 1102 is connected to the digit t^p clip 1103 by spring 1104. Force-transmitting 
tendon 1105 is affixed to platform 1101. Load cell 1100 is affixed to the digit side of 
platform 1101. For various reasons, such as when the load cell surface is not ragged or if 

15 the load cell is temperature sensative, a protective/teiiqraature insulating platform 1 1 06 is 
affixed to die digit side of die load celL When die tension in tendon 1105 is increased 
(FIG. 1 1c), platform 1101 presses on die load cell 1100 which in turn presses platform 
1106 against die digit tip. The load cell measures the tension in tendon 1105 at the digit 

20 

FIGs. 12a and 12b are side and plan views of a farce-applying platform which is 
capable of pivoting to make the contact pressure between the platform and the digit tip as 
uniform as possible. In this embodiment, platform 1200 pivots on hinge 1201 which is 
connected by support 1202 to return spring 1203, which in turn is affixed to digit tip clip 
25 1204. When tension is applycd to tendon 1205, platform 1200 contacts the digit tip and 
rotates on hinge 1201 to make the contact pressure uniform. 

FIG. 13 is a side view of an extension of FIG. 12, with the addition that the contact 
pressure distribution between platform 1300 and the digit tip may be modified by adjusting 
30 the tension in tendons 1301 and 1302. If the tension in tendon 1301 is greater than in 
tendon 1302, then the digit tip will detect greater contact force nearer the fingernail than the 
bottom of die digit tip. 

FIGs. 14a and 14b are the side and plan view of yet another embodiment which is 
35 used to modify the pressure distribution sensed by the digit tip. In this embodiment, 
platform 1400 is capable of pivoting in any direction due to die connection to support 
1401 via ball joint 1402. By varying the tension in tendons 1403 and 1404, the 
centroid of pressure may be shifted vertically, whereas varying die tension in tendons 
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1405 and 1406, the ocmroid of pressure may be shifted laterally. By uniformly varying 
the tension in all tendons, the magnitude of the pressure distribution may be changed 
aaxjiomglywin^sliffimg Although the embodiment provided only shows 

four tendons in a symmetric pattern, the concept obviously may be expanded to include 
more t e ndons and in more complex patterns. 



FIG. 15 is a side view of an embodiment showing how the tension in the tendon 
inay be measured trior to tl»platfb^ Platform 1500 is affixed to 

sirpportlSOl wfaichuaar*^ to todjgtupclipl502 via flexible riifeinw^isoj. 
10 The extent of flexion of 1503 is a measure of the force applied to platform 1500 by 
tendon 1506 until the platform contacts the digit tip. With tfriscapabffity, be sensed, 
among other things, when the tendon is slack. In the embodiment shown, the flexion is 
measured via differential strain gages 1504 and 1505. 

15 FIGs. 16a and 16b are side views of rwomcnenKtho^ 

and thus, fcroapph^totl»e body part In the embodiments provided, the tension is being 
measured near the force-generating actuator. The same measurement principles may be 
used to sense tendon tension at the force-sensing body part, for example, at a feedback 
glove. In FIG. 16a, tendon 1600 is wound on pulley 1601 winch ism me shaft of force- 

20 generating actuator 1602, which in the embodiment provided is a motor. The tendon 
passes over pulley 1603, under fixed pulley 1604 and enters casing 1605. Pulley 1603 
is affixed to the free end of cantilever 1606, while the other end of the cantilever is 
anchored securely. When tendon tension is increased, pulley 1603 is displaced 
downward, causing the cantilever also to displace downward. In the embodiment 

25 provided, this cantilever displacement is measured via differential strain gages 1607 and 
1608. Other displacement sensing technologies may be substituted. 

FIG. 16b shows how the tendon tension may be measured by sensing the stress in 
the tendon casing. Tendon 1609 leaves the force-generating actuator 1610 and enters a 
30 tendon casing stress sensing sleeve 1611. This sleeve is affixed to casing support 1612 
at one end, and not connected to anything at the other end. At the free end, the sleeve 
presses against a spacer 1613 which then presses against the main section of the tendon 
casing 1614 which guides the tendon to its destination. The spacer is not connected to 
anything, but may rest idle on the tendon. Casing 1614 is guided and supported by 
35 structure 1615. The stress experienced by stress sensing sleeve 1611 is sensed, in the 
erribodiment provided, by differential strain gages 1616 and 1617. The use of spacer 
1613 and support 1615 reduces the influence that lateral motion of casing 1614 would 
otherwise have on the sensed stress. 



WO 91/11775 



PCT/US91/(MHB2 



26 



FIGs. 17a and 17b axe side views of two embodiments of a structure which 
supports both a bend sensor (ag^ the strain gage bend sensor of Kramer et aL) and a 
force-transmitting tendon. FIG. 17a shows a cross sectional view of an embodiment 

5 where bend sensor 1700 is in guiding pocket 1701 in support structure 1702. The 
support structure is affixed in proximity to die joint whose angle is to be measured, shown 
in FIGs. 17a and 17b to be the PIP joint Force-transmitting tendon 1703 is also 
supported over the body part by structure 1702. The tendon may reside in a trough or 
pass through a hole in structure 1702. Structure 1702 should move in relation to the 

10 body part during flexure and may be made of a variety of materials including plastic, RTV 
silicon rubber and the like. 

FIG. 17b is a side view of a tendon/bend sensor support structure similar to FIG. 
17a but has portions of material removed 1704 from the structure 1705 to pennit easier 
15 bending. The dashed line outlines where die bend sensor 1706 may be positioned in the 
support structure. Although, in both FIGs. 17a and 17b, the bend sensor is shown 
positioned in the support structure between tendon 1707 and the body part, other 
topologies may be used, such as die tendon between the bend sensor and the body part. 

20 FIGs. 18a and 18b are a perspective and plan view of an embodiment which 

provides a pie-tension between a force feedback glove and die casing support wristband. 
The embodiment provided is a schematic representation and a variety of details may be 
added to support the functional parts. In this embodiment, there are two pulleys mounted 
on wristband 1800, one on the top 1801, one on the bottom 1802. The pulleys are able 

25 to translate in either direction along die axis of the forearm, optionally in a slotted guide, 
but are pulled in the direction away from die glove by elastic members 1803 and 1804. 
The pulleys may also be allowed to slide in a direction that is not parallel to, but has a 
component along the axis of die forearm. The glove is reinforced on both the top 1805 
and bottom 1806 (similar to top side reinforcement, but not shown). The reinforced 

30 sections are connected to each other via pie-tension tendon 1807 which passes over pulley 
1801, around the wrist (optionally over a bearing surface such as a series of roller 
bearings), and over pulley 1802. The reinforced glove sections serve to distribute the pre- 
tension force over the hand. The reinforcement may be extra material such as nylon, plastic 
or RTV silicon rubber. The wristband is strapped around the wrist at a location that places 

35 the elastic members in tension. The tension serves to draw the wristband toward the glove, 
without allowing the wristband to slide relative to the skin, and thus taking up die slack in 
the forearm skin so there is little motion of the wristband later when a force-transmitting 
tendon is placed in tension. 
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FIG. 19 is the block diagram of a three-loop force control system. The diagram is 
very similar to FIG. 10 with die addition of an inner servo loop that controls the force 
sensed at the output of the force actuator. This inner servo loop is a "fast loop" which may 
5 have a high gain to quickly adjust the force output by the force actuator based on sensing 
the output force near die force actuator itself. A computing device 1900 whichvhas 
knowledge of, for example, the environment, object shape, position and complance, 
determines a force set point 1901 for the control system based on additional knowledge of 
digit tip position which may be sensed by the Kramer et aL strain gage bend sensors 1902 
10 or suitable substitute. This force set rKnnt is coonjared to actual f^ 

by a suitable sensor 1903, such as the force-sensing platform or appropriate load ccIL The 
error in the force signal is input to the "slow loop" controller 1904 which may be running 
a standard control law. This is called the slow loop because the gain shouldn't be too high 
since there are some nonlinear dynamics involved, if die cable force-transmission system 
IS 1905 is employed. 

The output of die slow loop controller is the force set point 1906 to the "fast loop" 
control system. This fast loop set point is conroared to a force sensed (e.g., by the 
previously discribed strain gage cantilever 1907 of FIG. 16) at die output of the force 
actuator 1908 which produces the error signal input for die fast loop controller 1909 
which also may be running a standard control law. The gam of the fast loop may be large 
compared to the gain of the slow loop controller since die dynamics of this loop are fairly 
linear and are relatively fast if a good quality servo motor were used. Therefore, the 
tension output of the motor can be controlled to a desired value very quickly, whereas the 
force sensed at the digit tip cannot be servoed to a desired value as quickly without 
increasing the possibility of oscillation due to die nonlinear transmission system. 

By appropriately combining commands to the texture array and the force applicator, 
innumerous sensations may be applied to the digit rip. For example, by extending three 
30 texture elements along a single column and then actuating the force platform to press 
against the digit rip, die sensation of touching the digit tip to the vertical edge of a virtual 
object is simulated. If the three extended texture elements of the column are retracted at die 
same time that the three elements of the adjacent column are raised, a sensation mat the 
object edge is moving across the digit tip will be produced. This sensation may be used 
35 either when an object edge is moving and the digit tip is remaining stationary, or when the 
object position is fixed and die digit tip is moving across the edge. With appropriate 
modifications, force and texture may be simulated at other parts of the body besides the 
digit tip, such as is shown for the arm in FIG. 2c 
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While the invention has been described with reference to specific embodiments, the 
description is illustrative of the invention and is not to be construed as limiting the 
invention* Thus, various modifications and amplifications may occur to those skilled in the 
5 ait without departing .form the true spirit and scope of the invention as defined by the 
appended claims. 
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CLAIMS 

What is claimed is 

5 

1. A device for producing a signal at a sensing body part simulating the 
interaction between an interactive entity and a distal virtual or real object, said device 
comprising: 

10 means for generating a force simulating the interaction between said interactive 

entity and said object; and 

means for transmitting said generated force to said sensing body part 

15 2. A device according to Claim 1, wherein said generating means comprises: 

means for generating a force simulating the contact force of said interactive entity 
interacting with said object 

20 3. A device according to Claim 1, wherein said generating means comprises: 

means for producing a surface pattern simulating a surface of said object 

4. A device for producing a signal at a sensing body part simulating the 
25 interaction between an interactive entity and a distal virtual or real object, said device 
comprising: 

means for generating a force simulating the contact force of said interactive entity 
interacting with said object; 

30 

means for applying a force to said sensing body part, displaced from said sensing 
body part in a first unacdvated position and touching said sensing body part in a second 
activated position; 

.35 transmitting means operably connecting said generating means to said applying 

means. 



5. A device according to Claim 4, wherein said applying means comprises: 
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a force-applying platform; 

a supporting structure for holding said platform in juxtaposition to said sensing 
5 body part; 

retractable means for holding said force-applying platform in said first position. 
6. A device according to Claim 5, said applying means further comprising: 

10 

a force-sensmgplatfcffm; 

a fulcrum mounted on said force-applying platform and supporting said force- 
sensing platform; 

15 

mechanical means connecting said force-sensing platform to said transmitting 
means, wherein actuation of said force-sensing platform by said transmitting means moves 
said force-applying platform to said second position. 

20 7. A device according to Claim 4, said transmitting means comprising: 

a force transmitting flexible elongated element; 

a flexible housing for guiding said element from said force-generating means to said 
25 force-applying means; 

means for transferring said force from said element to said force-applying means . 

$. A device according to Claim 7, wherein said element comprises an inelastic 
30 tendon and said housing is incompressible. 

9. A device according to Claim 7, wherein said element comprises an 
incompressible fluid and said housing is inelastic 

35 10. A device according to Claim 7, wherein said device further comprises: 

force-sensing means attached to said element between said force-generating means 
and said force-applying means. 
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11. A device for producing a signal at a sensing body part simulating die surface 
interaction between an interactive entity and a distal virtual or real object surface, said 
device comprising: 

5 

a plurality of texture dements in a predetermined array; 

means for holding said array of texture elements in juxtaposition to said sensing 
body part; 

10 

means for generating forces to displace a plurality of texture elements simulating die 
interaction between said interactive entity and said object surface; and 

means for transmitting said generated forces to said texture element array to 
15 simulate said object surface to said sensing body part 

12. A device according to Claim 11 9 wherein said array is a 3 x 3 array of 
texture elements. 

20 13. A device for producing a signal at a sensing body part simulating the 

interaction between an interactive entity and a distal virtual or real object, said device 
comprising: 

first means for generating a force simulating die contact force of said interactive 
25 entity interacting with said object; 

means for applying a force to said sensing body part, displaced from said sensing 
body part in a first unactivated position and touching said sensing body part in a second 
activated position; 

30 

first transmitting means operably connecting said first generating means to said 
applying means; 

said applying means comprising a plurality of texture elements in a predetermined 
35 array in confronting relationship with said sensing body part; 

second means for generating force to displace a plurality of texture elements 
simulating the interaction between said interactive entity and said object surface; and 



WO 91/11775 



PCT/US91/00G32 



32 



second means for transmitting said second generated forces to said texture element 
anay to simulate said object surface to said sensing body part 

5 14. A device according to Claim 13 t wherein said applying means comprises; 

a force-applying platform comprising said plurality of texture elements; 

a supporting structure for holding said force-applying platform in juxtaposition to 
10 said sensing body part; 

retractable means for holding said force-applying platform in said first position. 

15. A device according to Claim 14, said applying means further comprising: 

15 

a force-sensing platform; 

a fulcrum mounted on said force-applying platform and supporting said force- 
sensing platform; 

20 

mechanical means connecting said force-sensing platform to said transmitting 
means, wherein actuation of said foroe-sensing platform by said transmitting means moves 
said force-applying platform to said second position. 

25 16. A man-machine interface device for producing a first signal to a sensing 

body part simulating the interaction between an interactive entity and a distal virtual or real 
object and manipulating said interactive entity in relation to said object, said device 
comprising: 

30 means for generating a force simulating the interaction between said interactive 

entity and said object; 

means for transmitting said generated force to said sensing body part as said first 

signal; 

35 

means for sensing position of a controlling body part and producing a second signal 
related to said position of said controlling body part; 
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signal collection and producing means for receiving said second signal, controlling 
the interaction between said interactive entity and said object in relation to said second 
signal and actuating said generating means to produce said first signal in relation to the 
interaction of said interactive entity and said object. 

5 

17. A man-machine interface according to Claim 16, 

wherein said generating means comprises first means for applying a force to said 
sensing body part, displaced from said sensing body part in a first unactivated position and 
10 touching said sensing body part in a second activated position; 

said transmitting means comprises applying means comprising a platform 
comprising a plurality of texture elements in a predetermined array in confronting 
relationshq) with said sensing body part; and further comprising: 

15 

second means far generating forces to displace a plurality of texture elements 
simulating the interaction between said interactive entity and said object surface; and 

second means far transmitting said second generated forces to said texture element 
20 array to simulate said object surface to said sensing body part 

18. A man-machine interface device for producing a first signal to a digit part 
simulating die interaction between an interactive rarity and a distal virtual or real object and 
manipulating said interactive entity in relation to said object, said device comprising: 

25 

a support for attaching to said digit part; 

a force applying means affixed to said support; 

30 means for generating a force simulating die interaction between said interactive 

entity and said object; 

means for transmitting said generated force to said digit part as said first signal; 

35 means for sensing position of a controlling digit part and producing a second signal 

related to said position of said controlling digit part; 

signal collection and producing means for receiving said second signal, controlling 



WO 91/11775 



PCT/US91/00d32 



34 



the interaction between said interactive entity and said object in relation to said second 
signal and actuating said generating means to produce said first signal in relation to the 
interaction of said interactive entity and said object 

5 19. A man-machine interface device according to Claim 18, wherein said 

support is a glove, said digit part is the digit tip, said transmitting means comprising a 
housing and a force-transmitting flexible elongated element guided by said housing, and 
further comprising: 

10 a guide member attached to said glove for directing said force transmitting element; 

a wriststrap; and 

said housing attached at one end to said wriststrap and at the other end attached 
15 proximal to said force generating means. 

20. A man-machine interface device according to Claim 19, wherein said 
applying means comprises: 

20 a force-applying platform movable from a first unactivated position to a second 

activated position in contact with said digit tip; 

a supporting structure for holding said force applying platform in juxtaposition to 
said digit tip; 

25 

retractable means for holding said force-applying platform in said first position; 

a force-sensing platform; 

30 a fulcrum mounted on said force-applying platform and supporting said force- 

sensing platform; 

mec h a n ical means connecting said force-sensing platform to said transmitting 
means, wherein actuation of said force-sensing platform by said transmitting means moves 
35 said force-applying platform to said second position* 
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